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Abstract 

We generalize to non equilibrium states Onsager's minimum dissipation principle. We also 
interpret this principle and some previous results in terms of optimal control theory. Entropy- 
production plays the role of the cost necessary to drive the system to a prescribed macroscopic 
configuration. 

PACS numbers: 05.70.Ln, 05.20.-y, 05.40.-a, 05.60.-k 
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I. INTRODUCTION 

In his classic work on irreversible processes Onsager introduced a quadratic func- 

tional of the thermodynamic fluxes (time derivatives of thermodynamic variables) and an 
associated variational principle, called the minimum dissipation principle, as a unifying 
macroscopic description of near equilibrium phenomena. The evolution of the thermody- 
namic fluxes is given by a system of linear equations which describes the relaxation to an 
equilibrium state. This system is the Euler equation associated to the minimum dissipation 
principle. Moreover the value of this functional along the solution of the relaxation equa- 
tions is proportional to the entropy production. The Onsager reciprocity relationships are 
included in this principle which can be considered, as Onsager did, the dynamical analogue 
of the maximal entropy condition in equilibrium statistical mechanics. 

Natural questions are how this theory can be extended to non equilibrium stationary 
states and how the restriction to small fluctuations can be relaxed. Typical examples of 
non equilibrium stationary states are systems in contact with reservoirs which maintain a 
constant flow of some physical quantity (heat, matter, electric charge,...). Other examples 
are provided by systems in weak external fields. The rigorous study of simple stochastic 
models of interacting particles has provided insight on these issues. These 

models typically give rise to non linear hydrodynamic equations and, for equilibrium states, 
Onsager's theory is recovered as a first order approximation for small deviations. 

In this paper we present a form of the minimum dissipation principle valid for a wide 
class of models which includes stationary non equilibrium states. For a detailed discussion 
of our general assumptions, which are satisfied for typical models of stochastic interacting 
particles, we refer to j^. The basic points are a Markovian description of the microscopic 
dynamics, the existence of a macroscopic dynamics (hydrodynamics) and the validity of a 
dynamical large fluctuation principle which generalizes the well known Boltzmann-Einstein 
formula for the probability of thermodynamic fluctuations. The form of the hydrodynamic 
equations and the main consequence of the large fluctuation principle, i.e. a Hamilton-Jacobi 
equation for the entropy, will be introduced in the next section. 

The minimum dissipation principle follows from the results obtained in the previous 
papers [3] and in particular from the decomposition of the hydrodynamic equation into two 
parts: a dissipative part proportional to the gradient of the entropy and a non dissipative 
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term orthogonal to it. The two terms have opposite transformation properties under time 
reversal, the non dissipative part being in this respect akin to a magnetic term. 

We emphasize that the minimum dissipation principle is of general validity. This has to 
)e contrasted with the principle of minimal entropy production which is of limited validity 

fi- 
ll. BASIC MACROSCOPIC EQUATIONS 

We consider the macroscopic description of non equilibrium conservative systems, that is 
systems in which the number of particles is locally conserved. The analysis of microscopic 
models of stochastic lattice gases in contact with particles reservoirs and/or weak external 
fields suggests that the following scheme may characterize a wide class of physical systems. 

1. There exists an entropy functional S({pi}) which depends on a finite number of local 
thermodynamic variables p«. The stationary state corresponds to a critical point of S 
so that it is a maximum of the entropy; here we stick to the physicists sign convention 
for S which is opposite to that of the previous papers. The relationship between S and 
the probability of a thermodynamic fluctuation is given by the Boltzmann-Einstein 
formula P ~ exp{N d AS} where N d is the volume of the system. 

2. The evolution of the fields pi = pi(t,u), where u represents the macroscopic space 
coordinates and t the macroscopic time, is given by a divergence type hydrodynamical 
equations of the form (from now on we omit for simplicity the indices) 

d tP = • p(p)Vp) - V • (x(p)E) = V(p) (1) 

where D is the diffusion matrix, \ the Onsager matrix, and E the external field. 
Equation (0) is obtained in the diffusive scaling with a microscopic drift of order 1/N. 
The interaction with the reservoirs appears as boundary conditions to be imposed on 
solutions of (0). We expect D(p) and x{p) to be local functions of the thermodynamic 
variables. We assume that there exists a unique stationary solution p of (Q), i.e. a 
profile p(u), which satisfies the appropriate boundary conditions such that T>(p) = 0. 
The entropy S(p) attains its maximum for p = p and we normalize it so that S(p) = 0. 
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3. The entropy S satisfies the following Hamilton- Jacobi functional derivative equation 



where (•, •) means integration with respect to the space variables. 

It is not obvious that a relationship such as (J2J) connecting the macroscopic entropy 
with hydrodynamics and Onsager matrix should exist. In fact (j2j) can be interpreted as a 
far reaching generalization of the fluctuation-dissipation theorem since it allows to express 
even in non equilibrium states a static quantity like the entropy in terms of two dynamical 
macroscopic features of the system. This is one of the main results of jjjj]. 

Another important result is the generalization to non equilibrium states of the Onsager- 
Machlup theory of dynamical fluctuations P|. Suppose at time t = — oo the system is 
in the stationary state p and at time t = we observe a profile p of the thermodynamic 
variable; we ask what is the trajectory along which this fluctuation has been created. In 
equilibrium the Onsager-Machlup theory tells us that this trajectory is the time reversal 
of the relaxation path which solves the hydrodynamic equation (0) with initial condition 
p. In non equilibrium the characterization of such a trajectory requires the introduction of 
the adjoint hydrodynamics which is defined as the hydrodynamic equation associated to the 
time reversed microscopic dynamics. Indeed in |3jJ, to which we refer for more detail, we have 
shown that the exit path is the time reversed of the solution to the adjoint hydrodynamics 
with initial condition p. 

In the present paper we shall also present a non probabilistic point of view in terms of 
optimal control theory. The dissipation function introduced in the next section is interpreted 
as a cost function when an external perturbation is used to produce a fluctuation. The 
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Hamilton-Jacobi equation becomes the Bellman equation, see e.g. [H|, of the associated 
control problem. 

III. MINIMUM DISSIPATION IN NON EQUILIBRIUM STATES 

The extension of the minimum dissipation principle to non equilibrium states follows from 
a structural property of the hydrodynamics in non equilibrium states established in [3]. By 
using the Hamilton-Jacobi equation (J2J), we showed that we can decompose the right hand 
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side of (JTJ) as the sum of a gradient of the entropy S(p) and a vector field A orthogonal to 
it in the metric induced by the operator K~ x where Kf = — V ■ (x(p)V/), namely 

V(p) = A* • U(p)V^) + A(J>) (3) 



2 v^ vry bp > 
with 

(a-|,a-M(p)) = (|mW> = o (4) 

Since A is orthogonal to SS/Sp, it does not contribute to the entropy production. 

Both terms of the decomposition vanish in the stationary state that is when p = p. 
Whereas in equilibrium the hydrodynamic is the gradient flow of the entropy S, the term 
A(p) is characteristic of non equilibrium states. Note that, for small fluctuations p ~ p, 
small differences in the chemical potentials at the boundaries, small external fields E, A(p) 
becomes a second order quantity and Onsager theory is a consistent approximation. 

Equation (JHJ) is interesting because it separates out the dissipative part of the hydro- 
dynamic evolution associated to the thermodynamic force || and provides therefore an 
important physical information. Notice that the thermodynamic force |^ appears linearly 
in the hydrodynamic equation even when this is non linear in the macroscopic variables. 

In general, the two terms of the decomposition © are non local in space even if D is 

nn 

a local function of p. This is the case for the simple exclusion process discussed in [3|, |4| • 
Furthermore while the form of the hydrodynamic equation does not depend explicitly on 
the chemical potentials, || and A do. 

The adjoint hydrodynamic mentioned in Section |H] is easily obtained from the decompo- 
sition (jSJ). In fact in |3[ it is shown that it has the form 

d tP = V*(p) = -iv • (X(P)V^) - A(p) (5) 

that is A is odd under time reversal. 

To understand how the decomposition (jSJ) arises microscopically let us consider a stochas- 
tic lattice gas. Let L be its Markov generator; we can write it as follows 

L= l -{L + L + )+ l -{L-L+) (6) 

where L + is the adjoint of L with respect to the invariant measure, namely the generator of 
the time reversed microscopic dynamics. The term L — L + behaves like a Liouville operator 
i.e. is antihermitian and, in the scaling limit, produces the term A in the hydrodynamic 



equation. This can be verified explicitly in the boundary driven zero-range model discussed 
in P). In the appendix we briefly discuss this model under more general conditions including 
a weak external field. For this model the decomposition J3J) can be obtained in two ways: 
macroscopically from T>(p) and S(p), microscopically deriving the hydrodynamics from the 
above decomposition of the generator. 

Since the adjoint generator can be written as L + = (L + L + )/2 — {L — L + )/2, the 
adjoint hydrodynamics must be of the form (JSJ). In particular if the microscopic generator 
is self-adjoint, we get ^4 = and thus T>(p) = V*(p). On the other hand, it may happen 
that microscopic non reversible processes, namely those for which L ^ L + , can produce 
macroscopic reversible hydrodynamics if L — L + does not contribute to the hydrodynamic 
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limit. This happens in the examples discussed in 

To formulate the minimum dissipation principle, we want to construct a functional of 
the variables p and p such that the Euler equation associated to the vanishing of the first 
variation under arbitrary changes of p is the hydrodynamic equation We define the 
dissipation function 



F(p, p) = {(p - A{p)), K-\p - A(p))) (7) 

and the functional 

Hp, p) = -Sip) + F(p, p) = -(^, p) + {(p - A(p)), k-\ p - A{p))) (8) 

which generalize the corresponding definitions in 
It is easy to verify that 

5^ = (9) 
is equivalent to the hydrodynamic equation ((TJ). Furthermore, a simple calculation gives 

F ^ = -4( v Tp> xip)v T P ) (10) 

that is 2F on the hydrodynamic trajectories equals the entropy production rate as in On- 
sager's near equilibrium approximation. 

The dissipation function for the adjoint hydrodynamics is obtained by changing the sign 
of A in (0). 

The decompositions and (j3J) remind the electrical conduction in presence of a magnetic 
field. Consider the motion of electrons in a conductor: a simple model is given by the effective 
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equation, see for example [12j |. 



P = - 




(11) 



where p is the momentum, e the electron charge, E the electric field, H the magnetic field, 
m the mass, c the velocity of the light, and r the relaxation time. The dissipative term 
p/r is orthogonal to the Lorenz force p A H. We define time reversal as the transformation 
p i — > — p, H i— > — H. The adjoint evolution is given by 



where the signs of the dissipation and the electromagnetic force transform in analogy to (j2J) 
and p. 

Let us consider in particular the Hall effect where we have conduction along a rectangular 
plate immersed in a perpendicular magnetic field H with a potential difference across the 
long side. The magnetic field determines a potential difference across the short side of 
the plate. In our setting on the contrary it is the difference in chemical potentials at the 
boundaries that introduces in the equations a magnetic-like term. 

IV. FLUCTUATION, DISSIPATION AND OPTIMAL CONTROL 

The spontaneous motion of the systems considered follows the hydrodynamic equation 
We introduce an external perturbation v acting on the system in such a way that the 
hydrodynamical equation becomes 



We want to choose v to drive the system from its stationary state p to an arbitrary state p 
with minimal cost. A simple cost function is 



where p(s) is the solution of (fT3|) and we recall that K(p)f = — V - (x(p)V/). More precisely, 
given p(ti) = p we want to drive the system to pfa) = p by an external field v which 
minimizes (114)1 . This is a standard problem in control theory, see Q|. Let 




(12) 



d tP = -V • (D(p)Vp) - V • (x(p)E) +v = V(p) + v 



(13) 




(14) 




(15) 
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where the infimum is taken with respect to all fields v which drive the system to p in an 
arbitrary time interval [ti,^]- The optimal field v can be obtained by solving the Bellman 
equation which reads 

min {l(v, K-\p)v) - (v(p) + v,^)} = (16) 

It is easy to express the optimal v in terms of V; we get 

v = (17) 
bp 

Hence f|16|) now becomes 

5<£*<> + <°<> = ° (") 

By identifying the cost functional V(p) with —S(p), equation (fTHj) coincides with the 
Hamilton-Jacobi equation (J2J). 

The time derivative of the entropy S(p(t)) when p(t) is the solution of the hydrodynamic 
equation (JTJ) is proportional to the dissipation function (J2J). By inserting the optimal v fT7j) 
in (JT3j) and identifying V with —S, we get that the optimal trajectory p(t) solves the time 
reversed adjoint hydrodynamics, namely 

d tP = -V*(p) (19) 

where T>*{p) is given in (J3J. The optimal field v does not depend on the non dissipative part 
A of the hydrodynamics. 

The generalized Onsager-Machlup relationship |3] states that a spontaneous fluctuation 
is created most likely by following the solution of 1)19)1 . By choosing the 'right' cost function 
(114)1 . this coincides with the best trajectory for the control problem. 

APPENDIX A: ZERO RANGE PROCESS WITH BOUNDARY CONDITIONS 
AND WEAK EXTERNAL FIELD 

Consider the zero range process which models a nonlinear diffusion of a lattice gas, see e.g. 
jl^j ]. The model is described by a positive integer variable t] x (t) representing the number of 
particles at site x and time r of a finite subset A^r of the ^-dimensional lattice, A^v = Z d nA^A 
where A is a bounded open subset of R d . The particles jump with rates g(r) x ) to one of the 



nearest-neighbor sites. The function g(k) is increasing and g(0) = 0. We assume that our 
system interacts with particle reservoirs at the boundary of A^ whose activity at site x is 
given by ip(x/N) for some given smooth strictly positive function ip{u). We consider the 
process also in a (space dependent) external field H(u) which modifies the rates by a local 
drift. 



The dynamics is specified by the generator = bulk + L 



Abound, where 



H 

7 7V,bulk 



f(v) 



H 

J N, bound 



\ E 9(v*)e HWN) - H{x/N) [f(v x ' y ) ~ Ml 

\x-y\=l 

1 



E {a(v,)e H 



(y/N)-H(x/N) 



(Al) 



x€A N ,y£A N 
\x—y\=l 



+ ^y/N)e H ^- H ^[f( V ^) - f{ V )]} 

in which t] x,y is the configuration obtained from t] when a particle jumps from x to y, and 
rj x,± is the configuration where we added (resp. subtracted]one particle at x. With respect 



to the boundary driven zero range process considered in Q), we simply introduced in the 
macroscopic scale a small space dependent drift A^ _1 Vi/(n) in the motion of the particles. 
The invariant measure Pn of this model is a product measure of the same form of the one 
discussed in yf in the case H = 0. 



Let 



(A2) 



set R(<f) = <p Z Jlp) i an d denote by (fi(p) the inverse function of 93 1 — ^ R((p). By the computa- 
tions given in [3|, we get that the hydrodynamic equation is 

d t p(t, u) = - A0(p(t, u)) - V • (<f>(p(t, u))VH(u)) ueA 

A (,AoJ 
4> (p(t,u)) = 4>{u) u edA 

which is of the form (0) with D(p) = 4>'(p)l, x(p) = and £ = Vff. 

Let us denote by p{u) the stationary solution of (|A3|) . the associated activity A (it) = 
4>{p{u)) solves 



-AA(u) - V • (X(u)VH(u)) = ueA 
A (it) = ip(u) u edA 
It is not difficult to show that the entropy S(p) is given by 



(A4) 



S(P) = - [ 

J A 



du 



p(u) lot 



0(pH) 
A(it) 



log 



Z(X(u)) 



(A5) 
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where Z has been defined in flA2|) . 

The decomposition © of the hydrodynamics (jA3|) is 



4v-(^vf)^A W -iv.(MvA) 

^(p) = -V • &(p)VH(u)) + \v ■ (^VA) 



(A6) 



and it is not difficult to check that the orthogonality condition 




(A7) 



holds. 



Recalling that p^ is the invariant measure let us consider the process with initial condition 
v, where v is a product measure with density profile po(u), namely 



Let now v T be the distribution at time r and TI{v t \pn) = — JdpN^^ log the relative 
entropy of v T with respect the p^. By local equilibrium it is possible to show that, as 



where p(t) is the solution of the hydrodynamic equation (jA3|) with initial condition po- We 
see therefore that in the scaling limit we obtain the dissipation in (|1U|) from the microscopic 
entropy production. 
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